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Abstract 

We propose a complexity measure which addresses the functional flexibility 
of networks. It is conjectured that the functional flexibility is reflected in the 
topological "diversity" of the assigned graphs, resulting from a resolution of 
their vertices and a rewiring of their edges under certain constraints. The ap- 
plication will be a classification of networks in artificial or biological systems, 
where functionality plays a central role. 
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1 Introduction 

Complexity measures have been proposed as measures for computational, statistical, 
or structural complex features in various contexts, for a review see |lj . A complexity 
measure for patterns, for example, arising in chaotic systems has been proposed in 
It is a measure theoretic concept and applies to ensembles of patterns. It 
is natural in the sense that it reflects the intuitive notion of a complex pattern 
being neither completely random nor completely regular, but having some structure 
instead. Complexity of hierarchical systems has been studied in The complexity 
measure there has the property of isolating the most diverse trees as the ones with 
maximal complexity. Intuitively one would expect that the complexity of a hierarchy 
is related to its diversification, i.e. to the number of non-isomorphic subtrees found 
at that level. The proposals of J3] reproduce this expectation. 

Our measure of complexity refers to more general systems described by networks 
with underlying graphs that have not necessarily a tree-like structure. Also we do not 
address the variety and the complexity of patterns which may be produced from nets 
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with simple topologies by adjusting the dynamical couplings attached to the edges. 
We are interested in the functional complexity of networks, natural and artificial 
ones, whose design is often optimized in view of a variety of possible functions. 
In particular the concept of functionality applies to networks in life science and in 
information science. Network motifs have been studied as characteristic building 
blocks for complex networks As a result, motifs shared by ecological food webs 
are specifically different from genetic networks. More generally, it has been found 
in jl] that motifs in networks of information processing are typically distinct from 
networks of energy transporting. Information processing may refer to nets as diverse 
as those of gene regulation, neurons and electronic circuits, for example. The overall 
conclusion is that frequently repeated motifs should represent certain functions. 

Our proposal of a complexity measure is in a similar spirit. We believe that 
the functional diversity of a network is determined by the topological "diversity" 
of the corresponding graph which results from rewiring the lines (we use "lines" 
rather than "edges") or breaking up the vertices (nodes) into pieces in all allowed 
ways. To make these concepts well defined, we use the framework of DLCE-graphs 
which have been proposed in jH] in a very different context. The former context was 
a bookkeeping of all analytic contributions to a given order in a generalized high- 
temperature expansion. Differently from the graphs that are mostly considered in 
connection with dynamical networks, DLCE-graphs have two types of vertices along 
with two types of connectivities, and, in general, more than one line connecting two 
vertices. In a superimposed dynamics, dynamical variables are associated with both, 
the vertices and the lines. We make use of a special operation on these graphs, later 
called the resolution of vertices. 

In section 2 we define DLC&graphs including some notions of a multiple-line 
graph theory as it was introduced in [5J. In section 3 we propose the measure of 
functional complexity and illustrate its use with some examples. Section 4 adds a 
summary of the physical background where DLCE-graphs were studied first. This 
section may be skipped by the reader who is not interested in the expansions where 
these graphs naturally occur. Section 5 gives the summary and a short outlook. 

2 DLCE-graphs and Networks 

Motivated by spin glass dynamics on lattices (with regular, random or other net- 
work topologies) we introduce so-called DLCE-graphs. DLCE stands for Dynami- 
cal Linked Cluster Expansions. These are systematic high temperature expansions 
generalized to systems where the spins and their couplings both have their own dy- 
namics and interact with each other. For further background on DLCE we refer to 
section 4 and Since the underlying dynamics of DLCE and the corresponding 
graphical expansion are quite generic, we generalize the usual definition of graphs 
to DLCE-graphs also in this context. 

DLCE-graphs have two types of connectivity. Vertices are connected via lines 
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and lines may be additionally connected via a different kind of vertex, here called 
beam. Therefore we have two kind of vertices. When we speak of vertices in the 
following, we mean the first type, and use "beams" for the second type. Two vertices 
may be connected via more than one line, but two lines may be connected at most 
via one beam, because each line belongs to exactly one beam. (In spin glasses the 
spins would live on vertices, the spin couplings on lines (there usually called links 
or bonds), and the self- interaction of the couplings induces the beams.) If a beam 
connects m lines, we call the resulting structure an m-line. A one-line coincides 
with a "usual" line. A multiple-line graph theory has been developed in Here 
we introduce only notions that we later need for our applications. We distinguish 
between internal and external lines: internal lines get vertices attached to both of 
their ends. For external lines we distinguish two types, a so-called $-line with a 
vertex attached to only one endpoint, and a U-line with no vertices attached to its 
endpoints. (In connection with spin glasses the external $-and [/-lines correspond 
to n-point correlation functions of $ (spin) or U (coupling)-fields.) In a generic 
network the external lines correspond to input-or output channels, where both may 
have $-or [/-variables attached, respectively. 

Let us now define in detail the notion of a DLCE-graph and the topological 
equivalence of two such graphs. A DLCE-graph is a strucure 

r = (/:r,A^r,i3r,4*\i?f\$r,^r). (1) 

Here Cr,A4r and Br are three mutually disjoint sets of internal lines of F, beams 
of F, and vertices of F, respectively. eI?\ i?p ■* are maps. E^?^ assigns the number 
of external $-lines to every vertex f G i3r, assigns the number of external 

[/-lines to every beam. $r and \l/r are incidence relations that assign internal lines 
to their endpoint vertices and beams to their internal lines, respectively. In our 
former applications of DLCE, lines were treated as undirected. So we do here for 
simplicity, because the generalization is easily done. On the other hand it will be 
necessary, if later our graphs are considered as so-called motifs, which do make use 
of directed lines, cf. section 3. We consider Br x Br as the set of unordered pairs 
of vertices {v,w) with v,w E Br- Then we have $r : ^C. — > Br x Br- We say v 
and w are the endpoint vertices of / G £r if ^r(0 = {''^^w). Similarly \l/r : C — *• 
A4r,l I — ^ ^r(0- associates with each internal line the beam it belongs to. 
Vice versa, a beam connects m > 1 internal lines, in particular the case of m = 1 
is allowed where the notion of beam-connectivity becomes redundant. As stated 
above, a line with only one vertex attached is an external (j)-lme, a line with no 
vertices attached is an external [/-line. A so-called u-line is shown in Fig.l. In a 
concrete realization the incidence relations •I'r and \l/r may be realized as a tuple 
of matrices ($r(^, i), ^r(^, 0); hj ^ {l...n}, k,l G {l...m}, defined in the following 
way. Given a graph F with n vertices, m internal lines, external 0-lines, Lu 
external [/-lines, r beams and a labelling of vertices and internal lines. $r(^,i) 
is a symmetric n x n-matrix with $r(z,j) equal to the number of internal lines 
connecting i and j for i ^ j, i,j G l...n. $r(z,i) equals to the number of external 
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Figure 1: A u-line made of u single lines connected via one beam. 



0-lines attached to vertex i. is a symmetric m x m-matrix with "^rik, = 1 if 
internal lines k and I, k I, belong to the same beam, "^rik, I) = else, "^rik, k) 
equals to the number of external [/-lines attached to line k. Notice that two vertices 
may be connected via more than one line, but two lines may be connected by at 
most one beam. (This asymmetry is a remnant of the dynamics for which DLCE 
have been originally proposed.) This tuple of matrices, representing the incidence 
relations, would be suited for computer implementations of DLCE-graphs. It allows 
for a computer aided algorithmic generation of graphs. 

Now we can formulate in a purely algebraic way when two DLCE-graphs are 
topologically equivalent. Two DLCE-graphs 

r, = (A,A^„S„i?f\i?f\<l>„vl/,) 1 = 1,2 (2) 

are called topologically equivalent if there are three invertible maps 

(pt3 ■ t3i — > B2 

<\)M-Mx — > M2 (3) 

between the set of vertices, internal lines, and beams of these graphs Fi and F2 such 
that 

$2 0(/)^ = 0bO$i (4) 

*2O0£ = 0A^O^l (5) 

and 

Ei'^^ o 0e = e['^^ (6) 

i?f ) o = ) . (7) 

Here o means decomposition of maps and 



0g : Si X Bi — > B2 X B2 

I — > {(j)B{v),(l)B{w)). (8) 

For example, (jU means that the following composition of maps are equivalent: first 
assign via $1 the endpoint vertices to a given internal line li of the first graph 
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Fi and map them to the corresponding vertices in r2 via 0^, or, alternatively, 
first map the given internal line of the first graph Fi to the corresponding internal 
line I2 of the second graph via 0£, and then associate the endpoint vertices with 
this line there via $2- Similarly, in a shorthand notation, (jSJ refers to the maps 
linepi — > beampi — > beampa or linepi — > linepa — > beamrj- Both orders 
are equivalent if the graphs are topologically equivalent. Eq.s (jHI), (0) state the 
equivalence of either assigning the external lines to a vertex of the first graph, or 
to the corresponding vertex of the second graph. Fig. 2 shows eight topologically 
inequivalent graphs on the r.h.s. of the map, while two topologically equivalent 
graphs would result from the graph on the l.h.s. by attaching the beam either to 
the lower or to the upper two internal lines. (Only the latter graph is shown in 
the figure.) The eight graphs on the r.h.s. result from so-called admissible vertex 
resolutions of the graph located most left. Admissible vertex resolutions will be 
defined below. 




Figure 2: Example of eight admissible, topologically inequivalent vertex resolutions 
with four internal lines of one common underlying graph. The beams are indicated 
via dashed lines. 

The definition of connectedness of a DLCE-graph with two types of connectivity 
can be traced back to the notion of connectedness of an LCE-graph with only one 
type of connectivity, for details we refer to [S]. 

Operations on DLCE-graphs Apart from operations like adding or removing 
vertices, lines and beams, with or without the attached structures, two operations 
are of interest in this context, the resolution of vertices and the resolution of beams. 
Let F be a DLCE-graph, v E Br a. vertex with n lines ending upon it, let FI G V{Cv) 
be any partition of the set of lines ending on v. We remove the vertex v and 
draw for every P G FI a new vertex v{P) so that all lines / G P enter the vertex v{P) 
rather than v before its removal. This procedure is called a vertex resolution of v. For 
an example see Fig.3. Note that this resolution procedure amounts to a rewiring of 
lines. It then depends on the dynamical constraints whether the resulting graph F is 
allowed or not. For example, the graph may become disconnected and fragmentize 
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Figure 3: Example of admissible ((a) and (b)) and non-admissible (c) vertex resolu- 
tions. In particular, the case of the trivial resolution (a) is admissible. The beams 
are drawn as dashed lines. 

into several pieces as a result of the resolution procedure. Such a resolution is 
forbidden if the considered graphs must be connected. More generally, a vertex 
resolution is called admissible if it satisfies all constraints from the dynamics or 
from the choice of observables (if the observable is the free energy density, the 
contributing graphs must be connected because of the logarithm of the partition 
function.) 

The same definition applies to the resolution of a beam. The set of all resolution 
patterns of a graph F is obtained by combining any admissible resolution of vertices 
V E Br and any admissible resolution of beams b E M.^ in all possible ways such 
that the resulting graph satisfies all characteristic features it should. 

The reason why we choose DLCE-graphs rather than Feynman graphs (mentioned 
in [Hj in a different context of networks or LCE-graphs [7^ is the following. The 
notion of resolution of vertices appears quite naturally in DLCE-graphs because 
graphs may stay connected in spite of "resolved" vertices due to the new feature of 
line-connectivity. We remark, however, that also in LCE-graphs one meets a similar 
resolution of vertices (although this notion is not introduced there) when calculating 
internal symmetry factors. Let us assume an underlying 0(A^)-symmetry of the 
system so that one of n "colors" ("flavors", features) may propagate along each 
line. In calculating the internal symmetry factor one looks for all possible paths 
along which color 1, say, can propagate from the input channel through the graph 
to yield color 1 on the output channel, while a closed loop may carry any of the 
colors, and only one color can propagate along a line at the same time. As an 
example consider the LCE-graph of Fig.4. Color 1 can propagate along the upper 
line, say h, leaving colors for the loop of the remaining lines, say I2 and /s, or 
along h,l2,h, or li,h,l2, or it could choose the intermediate or the lower line first. 
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Figure 4: 3 x [N + 2) possibilities for color 1 to propagate through the graph. For 
further explanations see the text. 

yielding 3 x (A^ + 2) possibilities all together. 

A resolution of vertices is furthermore encountered if the vertices correspond to 
knots, and we want to determine all trails or states of a given knot iSj. At each 
crossing of the knot a propagating "bit of information" would have to decide where 
to continue after the crossing. 

Finally, in mesoscopic or macroscopic networks one may associate with the so- 
called resolution of vertices rules on "traffic" regulation in generic networks of trans- 
portation where these rules regulate the traffic at crossing points. The rules should 
be quite distinct depending on whether energy or information flow is concerned. 

3 Proposal of the Complexity Measure 

After introducing DLCE-graphs in the last section we are now prepared to propose 
a measure for functional complexity of networks. It is defined as 

FCM := ^^(r) > (9) 

ie{i...N) 

that is, as the total number of topologically inequivalent admissible resolution pat- 
terns PA of the DLCE-graph F of that network. The prime stands for the restriction 
to topologically inequivalent and admissible patterns. A resolution pattern is ob- 
tained by allowing for any r„ (0 < r^, < n^) resolutions of vertices and any r;, 
(0 < < rib) resolutions of beams, ny,nb denoting the total number of vertices 
and beams, respectively. It is admissible if it is compatible with the constraints 
imposed by the dynamics. Two resolution patterns are topologically equivalent if 
there exist the three invertible maps between their associated graphs Fi and F2 
which satisfy ©- ©. 

Examples for dynamical constraints are the following: 

• After the resolution of vertices the resulting graph should stay connected. 

• Vertices and/or beams have an even number of lines attached. 

• There are no lines with coinciding endpoints (i.e. no self-lines or tadpoles). 
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Some further comments to our proposal are in order. In our definition of the com- 
plexity measure we count all admissible resolution patterns of graphs without as- 
signing probabilistic weights. In the background of spin glasses the weight was given 
by an analytic expression proportional to some power n of an expansion parameter 
K where n equals the number of internal lines in the graph. In general the weights 
for resolution patterns will depend on the imposed dynamics. 

Our conjecture is that the restriction to topologically inequivalent resolution pat- 
terns projects on the inequivalent functionalities. Let us consider again the example 
of the graph of Fig. 4 with one input and one output channel and three topologically 
inequivalent resolutions. In Fig. 4 a) a bit of information may be transported via the 
upper line through the network while another bit may be stored in the closed loop, 
in b) and c) one bit propagates through the graph in a different order, without a 
decoupled loop as in a). 

Another example is provided by two motifs observed in foodwebs (Fig. 5 a)) and 
in networks of gene regulation (Fig. 5 b)). According to our definition the directed 




a) b) 



Figure 5: After resolution of its vertices the motif of a feedforward-loop (a) leads to 
the motif of a three-chain and a two-chain (b) . 



three-chain from x io z with a disconnected (here redundant) string (Fig. 5 b)) re- 
sults as a resolution of a feedforward loop (Fig. 5 a)) occurring in networks of gene 
regulation, neurons and electronic circuits. In this example the interpretation of 
different motifs as resolution patterns of a common underlying graph appears su- 
perficial, because it is more the specific difference rather than a common underlying 
structure one is interested in. In case of more intricate motifs as in genetic or ar- 
tificial networks the notion of inequivalent admissible resolution patterns may be a 
sensible measure for the variety of functionalities of these networks. 



4 Background of DLCE 

DLCE-graphs have been proposed in a graphical representation of a systematic 
generalized high temperature expansion of In Z, where Z is the partition function 
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of a certain class of models characterized by an action (Hamiltonian) of the form 
S{<f>,U,v) = Y,S'{<l>{x)) + J2s\U{l))-^- J2 v{x,y)<P{x)U{x,ymy), (10) 

with couplings 

v{x,y) = v{y,x) ^ for (x, ly) G Ai, 
in particular v{x, x) = 0, 

Ai = {l = {x,y)\v{x,y)^0}. (11) 

The field (f){x) is associated with the sites x E Aq where Aq is the set of all lattice 
sites, the field U{1) lives on the links (in this paper called lines) / G Ai, we write 
U{x,y) = U{1) for / = {x,y). In applications to spin glasses the G ±1 are the 
(fast) Ising spins and the [/ G R are the (slow) interactions. The action is split 
into two ultralocal parts, depending on fields on single sites, and depending 
on fields on single links /. For simplicity we choose as the same function for all 
links / G Ai. The support of v{x,y), here equal to Ai, need not be restricted to 
nearest neighbors, also the precise form of and does not matter for the generic 
description of DLCE. and can be any polynomials in (p and U, respectively. 
The only restriction in that context is the existence of the partition function. 

The interaction term v{x,y) (f){x) U{x,y) (p{y) contains a point-link-point inter- 
action and generalizes the 2-point interactions v{x,y) (f){x) (f){y) of usual hopping 
parameter expansions. The effective coupling of the (p fields has its own dynamics 
governed by S^{U), the reason why we have called the new expansion scheme dynam- 
ical LCE. Dynamical linked cluster expansions are induced from a Taylor expansion 
of W{H,I,v) = hiZ{H,I,v) about v = 0, the limit of a completely decoupled sys- 
tem. A prominent model which is contained as a special case is the Sherrington- 
Kirkpatrick model ^ with spin variables (f) G { — 1,+!}, real-valued U and infinite 
range of connectivity. Because of the general feature that the couplings U of the 
"spin" degrees of freedom are not frozen to a specific pattern but have their own 
dynamics, we had to introduce the additional notion of multiple-line connectivity, so 
that additional graphs become connected via beams, connecting the internal lines, 
and contribute to In Z. InZ is the generating functional of all DLCE-graphs in 
the vacuum. A^-point correlation functions can be derived from InZ in the usual 
way, leading to the distinction of internal and external lines, external 0-or t/-lines, 
depending on the choice of 0-or ^/-correlation functions as observables. The dynam- 
ical constraints restricting the admissible vertex resolutions which are specific for 
the class of models (llUj) have been mentioned in the previous section. The weight 
of a DLCE-graph is an analytic expression contributing as one term in the expan- 
sion of In Z. Notions like the resolution of vertices were introduced in in order 
to systematically generate all DLCE-graphs from the more simple LCE-graphs. In 
spite of resolutions, graphs may stay connected in this framework if the lines are 
connected via beams. The assignment of DLCE-graphs to generic networks in the 
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present context is obviously quite different from the original one, but due to their 
generic structure not restrictive at all. 

5 Summary and Outlook 

We have proposed a static measure which is sensitive to the topological diversity 
of a graph if we allow for splitting of vertices and induced rewiring of lines. To 
make this measure well defined we used the concept of DLCE-graphs because the 
resolution of vertices was a natural operation in the original framework where DLCE- 
graphs were used. Moreover DLCE-graphs cover more familiar graphs with only line- 
connectivity as special cases. The actual probability for a certain resolution pattern 
of a DLCE-graph depends on the imposed dynamics. In biological applications we 
expect this measure to be a good indicator for the functional diversity and therefore 
the flexibility of a network. The subgraph with the highest degree of complexity as 
defined here may be found on top of a hierarchical system. The various resolution 
patterns then amount to different functions the network is able to fulfill. Vice versa, 
interpreting different patterns, in particular motifs, as result of a common graphical 
substructure may serve as a classification of networks with respect to their various 
functionalities. Imposing concrete dynamics on networks with DLCE-graphs will 
allow to relate our complexity measure to others. For a given architecture of the 
DLCE-graph it then makes sense to ask how many distinct and independent specific 
tasks the network can perform at the same time. For computational tasks the 
functional complexity may then reflect the computational complexity. 
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